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Architecting  the  Future 
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Architecture,  Agile  Development, 
and  Business  Agility 
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The  Opportunity 


Background: 

•  Bolsa  Mexicana  de  Valores  (BMV) 
operates  the  Mexican  financial  markets 
under  license  from  the  federal  government. 

•  Bursatec  is  the  technology  arm  of  the 
BMV. 

•  BMV  desired  a  new  trading  engine  to 
replace  the  existing  stock  market  engine 
and  integrate  the  options  and  futures 
markets. 

•  The  BMV  performed  a  build  vs.  buy 
analysis,  and  decided  to  replace  their  three 
existing  trading  engines  with  one  in-house 
developed  system. 
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The  Project 


Bursatec  committed  to  deliver  a  trading  engine  in 
8-10  quarters: 

•  High  performance  (as  fast  or  faster  than  anything  out  there) 

•  Reliable  and  of  high  quality  (the  market  cannot  go  down) 

•  Scalable  (able  to  handle  both  spikes  and  long-term  growth  in  trading 
volume) 

Bursatec  approached  the  SEI  for  support  during  design  and  development. 

SEI’s  role — provide  methods,  techniques,  and  guidance  to  improve 
Bursatec’s  software  delivery  capability: 

•  Training  and  coaching  for  the  system  architects 

•  Training  and  coaching  for  the  development  team 
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A  Partial  List  of  Potential  Problems 


Complicating  factors: 

•  Pressure  -  managers  replaced  when  commitments  are  not  met 

•  Inexperience  -  available  staff  talented  but  young 

•  Large  project  -  scope  of  the  project  beyond  the  organization’s  recent 
experience 

—  #  of  person-months 

—  #  KLOC/function  points 

—  #  of  interconnecting  platforms 

—  #  of  individual  projects 

•  Key  implementation  technologies  never  used  together  formally 

•  Constant  stream  of  new  requirements/changes  to  business  rules 
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The  Proposed  Solution 


Engineering  process  using  Architecture-Centric  Engineering  (ACE) 
practices 

•  Proven  technology 

•  Strongly  addresses  technical  aspect  of  the  early  project  lifecycle 
(requirements,  architecture  design) 

•  Key  managers  familiar  with  technology  via  training  courses 

Management  process  using  the  Team  Software  Process  (TSP) 

•  Proven  technology 

•  Strongly  addresses  management  and  measurement  across  the  project 
lifecycle,  especially  later  phases  (implementation,  test) 

•  Key  managers  familiar  with  technology  only  through  word-of-mouth  and 
literature 
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Polling  Question  #1 


Have  you  used: 

•  Architecture  practices  with  TSP/PSP  (or  CMMI) 

•  Architecture  practices  (without  TSP) 

•  TSP/PSP  (without  architecture  practices) 

•  Neither 
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The  Engineering  Process 


Two  iterative  processes  based  on  the  architecture  of  the  system: 

Design  cycle.  The  goal  of  the  Implementation  cycle.  The  goal 
iterations  shown  on  the  left  side  of  the  iterations  shown  on  the 
is  to  design  a  system  that  right  side  is  to  implement  the 

ensures  business  success.  system  according  to  the  design. 
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The  Engineering  Process  - 

Entry  Condition 


The  entry  condition  for  the  design 
cycle  includes: 

•  The  availability  of  defined, 
prioritized,  and  measurable  quality 
attribute  requirements 


•  A  measurable  definition  of  the  important  quality  attribute  requirements 

•  At  least  five  high  important  quality  attribute  scenarios 


During  the  design  cycle  these  quality  attribute  scenarios  will  be 

•  Refined  to  more  specific  cases 

•  Transformed  into  an  architecture  design  supporting  these  scenarios 

•  Annotated  with  a  list  of  known  risks  showing  the  degree  of  support  by  the 
current  architecture 
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The  Engineering  Process  - 

Design  Cycle 


Designing  a  software  system  is 
defining  structures  that  support  the 
quality  attribute  requirements,  such  as 
performance,  availability,  extensibility,  etc. 


BUSINESS  AND 
MISSION  GOALS 

ARCHITECTURE 

SYSTEM 

The  methods  used  in  the  design  cycle  are  a  combination  of  a 

•  Design  method  to  transform  the  quality  attribute  requirements  into  an 
appropriate  design,  Attribute  Driven  Design  (ADD) 

•  Documentation  method  to  document  the  design  to  be  used  for  evaluation 
and  development,  Views  &  Beyond  (V&B) 

•  Review  process  to  continuously  check  the  design  to  identify  weaknesses, 
peer  reviews  using  Architecture  Tradeoff  Analysis  (ATAM)  techniques. 

Other  activities,  such  as  quality  attribute  modeling  might  be  necessary. 
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The  Engineering  Process  - 

Do  Not  Plan  a  Separate  Documentation  Task 


Documentation  and  reviews  are  not 
separate  tasks.  They  are  part  of  the 
design  process. 


At  no  point  in  time  is  there  a  need  to  plan  separate  tasks  for 
documentation  and  reviews  during  the  design  of  the  architecture. 

Documentation  and  reviews  are  done  continuously  while  designing. 

•  Designing  an  architecture  means  providing  evidence  that  the  quality 
attribute  requirements  are  supported. 

•  Evidence  is  best  provided  in  written  form  (documentation). 

•  Written  evidence  can  easily  be  evaluated  by  peers  not  involved  in  the 
project. 

Providing  evidence  results  in  high  confidence  that  the  designed 
architecture  is  appropriate. 
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The  Engineering  Process  - 

Documentation  as  Evidence 


cmpHigh  Availability  view  f 


P  lipase; 

The  purpose  of  this  diagram  isto  showhowinformation  flows  from  the  point  of  viewof 
high  availability.  On  one  partition  only  one  Auction  Engine  can  be  active  and  the  others 
must  be  backups.  Forthe  posable  dates  of  the  Auction  engine,  please  refer  to  the  date 
diagram . 


Create  diagrams  that  show  how  the 
architecture  supports  the  scenarios. 

UML  modeling  tools  are  appropriate. 

UML  models  are  NOT  for  stakeholders 
other  than  architects  and  developers. 
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The  Engineering  Process  - 

Organize  Documentation  Around  Scenarios 


;  k 

this  links  to  external  files  either  local  or  in  a  remote  file 
Server. 

This  also  can  link  to  a  web  server  if  the  files  are  stored 
there. 

^  \\fileserver\projeot\file 


_ |  QA-Packagel  : 

Sequence 
Diagram  1 


_ |  QA-Packagel 

Sequence 
Diagram  2 


Organize  the  documentation  in 
such  a  way  that  everything  that 
supports  a  quality  attribute 
scenario  can  be  found  quickly. 

Having  a  tool  that  supports  the 
linking  of  documents  is  very 
helpful. 
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The  Engineering  Process  - 

Continuously  Review  by  Peers 


Review  the  progress  made  in  the 
architecture  at  least  every  two  weeks. 


Use  ATAM  techniques  for  the  peer  reviews. 


Every  review  takes  two  to  three  hours  and  requires  the  presence  of  one 
or  two  questioners,  one  scribe,  and  the  architect(s). 

•  Two  scenarios  are  picked  for  the  peer  review. 

•  A  list  of  architecture  approaches  is  elicited  and  written  down  by  the  scribe  -  if 
not  already  existent. 

•  Every  problematic  architecture  decision  is  written  down  as  a  risk. 

•  Every  unknown  answer  is  written  down  as  a  to-do  item. 


If  there  are  unmitigated  risks  and/or  open  to-do  items,  then  the  review  will 
be  repeated. 
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The  Engineering  Process  - 

Risk  Items  per  Scenario  as  Progress  Measure 


Stakeholders  understand  scenarios 
and  risks. 


Do  not  try  to  show  progress  to  the  project  manager  and  other 
stakeholders  by  showing  them  how  your  UML  diagrams  evolved.  They 
will  not  see  any  progress. 

Stakeholders  understand  their  quality  attribute  scenarios  and  they 
understand  risks. 


To  show  progress,  show  the  quality  attribute  scenarios  with  the  attached 
list  of  risks  and  to-do  items  from  the  peer  reviews. 

Over  time  this  list  shrinks  and  therefore  shows  progress  to  the  project 
manager. 
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Polling  Question  #2 


What  architecture  practices  have  you  used?  (check  all  that  apply) 

•  Architecture  design  driven  by  quality  attribute  requirements 

•  Documentation  of  multiple  views  to  guide  architecture  design 

•  Architecture  evaluation 

•  Documentation  of  module  views  to  guide  implementation 

•  Architecture  conformance 
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The  Engineering  Process  - 

Implementation  Cycle 


The  implementation  cycle  is  centered 
around  establishing  communication 
between  architects  and  developers. 


An  architecture  that  shows  how  well  the  scenarios  are  supported  is  not 
enough  to  be  implemented  correctly. 

•  Module  views  help  to  describe  the  architecture  clearly  enough  for 
implementation. 

•  Active  design  reviews  (ARID)  help  to  communicate  the  architecture 
effectively  to  the  developers. 

•  Conformance  reviews  help  to  continuously  check  if  code  and  architecture  are 
synchronized. 
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The  Engineering  Process 

Module  Views 


class  Detail  Design 


BUSINESS  AND 
AT  SSI  ON  GOALS 

ARCHITECTURE 

SYSTEM 

Every  module  (implementation 
unit)  has  a  description  showing 
the  module’s: 

•  Interface 

•  Parts  (if  already  known) 

•  Allowed  usage  of  other 
modules 
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The  Engineering  Process  - 

Active  Reviews  for  Intermediate  Designs  (ARID) 


An  active  design  review  (ARID) 
established  understanding  of  the 
architecture  quickly  and  efficiently. 


BUSINESSAND 
AT  SSI  ON  GOALS 

ARCHITECTURE 

SYSTEM 

Have  a  two  to  three  hour  workshop  with  the  developers  and  architects  to 
transition  from  developing  the  architecture  to  using  the  architecture. 


•  Provide  the  documentation  to  the  developers. 

•  Present  one  or  two  use  cases  to  the  developers. 

•  Ask  developers  to  sketch  what  they  think  they  have  to  do  to  implement  the 
use  case. 


•  Developers  can  ask  architects  any  question.  Architects  note  the  questions,  to 
further  improve  the  documentation. 

•  After  two  hours  the  developers  describe  what  they  would  have  to  do. 

•  Architects  note  any  discrepancy,  to  improve  the  architecture. 
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The  Engineering  Process  - 

Conformance  Reviews 


Continuously  check  that  the 
implementation  follows  the  architecture 
(e.g.,  every  second  week). 


Have  a  two  to  three  hour  review  workshop  with  the  developers  and 
architects.  Developers  provide  documentation  (generated  by  tool) 
showing: 

•  Classes  /  functions  that  implement  the  module  -  the  module  classes. 

•  Uses  relations  the  module  classes  have  with  other  classes 


•  Module  classes  in  the  package  /  sub-system  hierarchy. 

Architects  and  developers  compare  the  generated  documentation  against 
the  architecture  document. 


For  every  discrepancy,  it  is  decided  to  either  fix  the  architecture  or  the 
code. 
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The  Engineering  Process  - 

Iterations 


Design  and  implementation  cycles 
can  be  run  one  after  the  other  or  in 
alternating  iterations 


BUSINESS  AND 
MISSION  GOALS 


The  duration  of  an  iteration  depends  on  the  nature  of  the  project. 
Iterations  should  be  between  four  to  eight  weeks. 
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The  Management  Process  - 

Team  Software  Process  (TSP) 


TSP  builds  high-performance  teams  from  the  bottom-up. 


Team 

Management 


Team 

Building 


Team 

Member 

Skills 


Team  communication 
Team  coordination 
Project  tracking 
Risk  analysis 

Goal  setting 
Role  assignment 
Tailored  team  process 
Detailed  balanced  plans 


Process  discipline 
Performance  measures 
Estimating  &  planning  skills 
Quality  management  skills 
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The  Management  Process  - 

Personal  Software  Process  (PSP) 


The  Personal  Software  Process  (PSP)  discipline  is 
essential  to  TSP. 


Team  Management 
Team  Building 


Team  Member  Skills 


Individual  developers,  including  architects 

•  select,  adapt,  or  define  their  own  processes 

•  estimate,  plan,  and  track  their  work  based  on  these  processes 

•  take  their  own  measurements  and  use  this  data  to  manage  both  the  schedule 
and  the  quality  of  the  work 

•  constantly  improve  their  processes  based  on  results  and  the  data 


PSP  training  is  the  basic  training  for  these  skills. 
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Polling  Question  #3 


What  PSP  /  TSP  training  have  you  participated  in?  (check  all  that  apply) 

•  PSP  Developer  Training 

•  TSP  Team  Member  Training 

•  TSP  Team  Leader  Training 

•  TSP  Coaching 

•  TSP  Executive  Seminar 
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The  Management  Process  - 

TSP  Measurement  Framework 


Schedule 


Effort 


Size 


Quality 


Team  Building 


Team  Member  Skills 


>Four  base  measures 


>  Apply  to  all  processes 
and  products 

>  Estimates  are  made 
during  planning 

>  Directly  measured  by 
team  members  while 
working 
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The  Management  Process  - 

TSP  Launch 


Team  Management 

Team  Building 

Team  Member  Skills  1 


The  most  important  outcome  is  a 
committed  team. 
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Team  goals 

Conceptual 

Team 

strategy 

Task  hour 
plan 

Team  roles 

Task  plans 

Quality  plan  Risk 

evaluation 

design 

Team 

Schedule 

Alternative 

Planned 

products 

Size 

estimates 

process 

plan 

Earned - 
value  plan 

Detailed 

plans 

plans 
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The  Management  Process  - 

TSP  Launch  and  Coaching  Support 


A 

jm 

4 

Team  Building 

Tea , 

m  Member  Skills  A 

TSP  supports  an  iterative  or  cyclic 
development  strategy. 

TSP  can  be  introduced  starting  at 
any  phase  or  any  cycle. 

Each  cycle  starts  with  a  launch  or 
re-launch  and  ends  with  a 
postmortem. 

The  TSP  coach  guides  the  team 
through  each  launch,  re-launch, 
and  postmortem,  and  provides 
weekly  coaching  support  during 
the  cycle. 


Business 

and 

technical 

goals 


Estimates,  plans, 
process,  commitment 
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The  Management  Process  - 

Weekly  Team-working  Framework 


Team  Building 
Team  Member  Skills 


A 


Team  member’s  track  plans  daily 


Bob 

Tom 

Sally 

John 

Tyra 

Pablo 

Gloria 

Abhinav 

Team  plans  are  consolidated  and  reviewed  weekly 

Galileo 

Protec 

RSM 

Management  reviews  are  typically  monthly 
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The  Management  Process  - 

Weekly  Status 


A 

a 

■ 

Team  Building 
m  Member  Skills  ^ 

Tea 

Team  members  meet  each  week  to 
assess  progress. 

•  Role  managers  present  evaluation 
of  the  plan  and  data 

•  Goal  owners  present  status  on 
product  and  business  objectives 

•  Risk  owners  present  status  on  risk 
mitigation  plans  and  new  risks 

•  Team  members  present  status  on 
their  plans 

Plan  deviations  are  addressed  each 
week. 

Significant  deviations,  such  as  new 
requirements  or  a  staffing  change 
would  trigger  a  replan. 


Performance  Data  Reviewed 

•  Baseline  Plan  Value 

•  Plan  Value 

•  Earned  Value 

•  Predicted  Earned  Value 

•  Earned  Value  Trend 

•  Plan  Task  Hours 

•  Actual  Task  Hours 

•  Tasks/Milestones  completed 

•  Tasks/Milestones  past  due 

•  Tasks/Milestones  next  2  weeks 

•  Effort  against  incomplete  tasks 

•  Estimation  Accuracy 

•  Review  and  Inspection  Rates 

•  Injection  Rates 

•  Removal  Rates 

•  Time  in  Phase  Ratios 

•  Phase  and  Process  Yield 

•  Defect  Density 

•  Quality  Profile  (QP) 

•  QP  Index 

•  Percent  Defect  Free 

•  Defect  Removal  Profile 

•  Plan  to  Actual  Defects 
Injected/Removed 
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Managing  the  Engineering  Process  -  Iteration  1 


A  possible  sequence 
of  iterations  for  one 
architecture  and  one 
developer  team  ... 
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Iteration  1 

•  Architects  -  Use  the  five  most  important  quality  attribute  requirements  to 
design  the  architecture  in  enough  detail  to  separate  what  is  known  from 
what  is  unknown. 

•  Developers  -  Prepare  development  environment. 
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Managing  the  Engineering  Process  -  Iteration  2 


Design  and 
implementation 
cycles  continued  ... 


Iteration  2 
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•  Architects  -  Describe  the  well  understood  parts  of  the  architecture  in 
enough  detail  to  be  implemented. 

•  Developers  -  Create  prototypes  that  provide  answers  to  identified 
architecture  problems. 
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Managing  the  Engineering  Process  -  Iteration  3 


Design  and 
implementation 
cycles  continued  ... 


Iteration  3 
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•  Architects  -  Design  the  rest  of  the  architecture  in  enough  detail  to  be 
implemented,  using  the  results  of  the  prototyping. 

•  Developers  -  Build  a  “skeleton”  system  of  the  known  parts  of  the 
architecture.  Implement  one  simple  feature  in  the  skeleton  system 
(1st  deliverable  to  be  shown  to  the  stakeholders). 
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Managing  the  Engineering  Process  -  Iteration  4 


Design  and 
implementation 
cycles  continued 
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Iteration  4 

•  Architects  -  Perform  an  architecture  evaluation  ATAM  and  make 
necessary  adjustments  in  the  architecture. 

•  Developers  -  Implement  skeleton  of  the  remaining  system. 
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Managing  the  Engineering  Process  -  Iteration  5 


Design  and 
implementation 
cycles  continued 
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Iteration  5 

•  Architects  -  Architecture  tasks  are  fading  out  now.  One  architect  continues 
to  solve  discovered  issues. 

•  Developers  -  Implement  the  next  feature  in  the  skeleton  system 
(2nd  deliverable  to  be  shown  to  the  stakeholders). 

This  type  of  iteration  now  repeats  until  all  features  are  implemented. 
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TSP  and  ACE  -  Principles  in  Common 


On  the  surface,  TSP  and  ACE  are  very  different  disciplines. 

•  TSP  is  a  self-directed  management  and  measurement  process. 

•  ACE  provides  sophisticated  technical  development  methods. 

Common  principles  allow  TSP  and  ACE  to  work  well  together. 

•  emphasis  on  business  and  quality  goals 

•  emphasis  on  engineering  excellence 

•  emphasis  on  defined  processes  and  process  discipline 

•  emphasis  on  teamwork 
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Important  Lessons  Learned  (So  Far) 


TSP  and  ACE  are  not  simply  compatible,  they  are  complementary. 
Learning  cycles  can  be  shortened;  they  cannot  be  short-cut! 
Architecture  can  be  coached. 

TSP  provides  a  disciplined  framework  for  measuring  and  managing  any 
structured  intellectual  activity. 

Architectural  awareness  helps  to  structure  the  team  and  the  work  in 
addition  to  the  product. 
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Architecture  Training  to  Support  the  Engineering 
Process 


Six  Courses 
Software  Architecture 
Principles  and  Practices  * 

Documenting 
Software  Architectures 

Software  Architecture 
Design  and  Analysis 

Software  Product  Lines 
ATAM  Evaluator  Training 
ATAM  Leader  Training 
ATAM  Observation 


Certificate  Programs  Certification 
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Product  Lines 


Evaluating 

Software 

Architectures 


:  required  to  receive 


certificate  /  certification 


*:  available  through  e-learning 
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Personal  Software  Process 
(PSPSM)  training  is  essential  to 
successful  TSP  implementation. 


Leading  a  Dcvdopnu 


Introduction 
to  the 
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Watts  S.  Humphi 


PSpsm  ancj  tsp  Training  to  Support  the 
Management  Process, 


IT  Jl 


Introduction  to  the 

Team  Software 


Personal  I  Process 
Software 
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TSP  Executive  Seminar  (1  day  for  top-level  execs,  middle  managers) 
TSP  Team  Leader  Training  (3  days  for  team  leads,  affected  managers) 
•  PSP  Fundamentals  (5  days  for  software  developers) 

TSP  Team  Member  Training  (3  days  for  other  disciplines) 
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Contact  Information 


TSP  Initiative 

James  W.  Over 
TSP  Initiative  Lead 

iwo@sei.cmu.edu 

Jim  McHale 
TSP  Mentor  Coach 

idm@sei.cmu.edu 


RTSS  Program 

Linda  Northrop 
RTSS  Program  Director 

lmn@sei.cmu.edu 

Felix  Bachmann 
Architecture  Mentor  Coach 

fb@sei.cmu.edu 


Business  Development 

David  Scherb  dscherb@sei.cmu.edu 
Greg  Such  asuch@sei.cmu.edu 

SEI  website  at  www.sei.cmu.edu  (~/tsp  or  -/architecture) 
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Intellectual  Property 


Personal  Software  Process,  PSP,  Team  Software  Process,  and  TSP  are 
service  marks  of  Carnegie  Mellon  University. 

Architecture  Tradeoff  Analysis  Method  and  ATAM  are  registered  in  the 
U.S.  Patent  and  Trademark  Office  by  Carnegie  Mellon  University. 


Software  Engineering  Institute  Carnegie  Mellon  * Fa** 

Twitter:  #seiwebinar 


NO  WARRANTY 


THIS  CARNEGIE  MELLON  UNIVERSITY  AND  SOFTWARE  ENGINEERING  INSTITUTE 
MATERIAL  IS  FURNISHED  ON  AN  “AS-IS"  BASIS.  CARNEGIE  MELLON 
UNIVERSITY  MAKES  NO  WARRANTIES  OF  ANY  KIND,  EITHER  EXPRESSED  OR 
IMPLIED,  AS  TO  ANY  MATTER  INCLUDING,  BUT  NOT  LIMITED  TO,  WARRANTY 
OF  FITNESS  FOR  PURPOSE  OR  MERCHANTABILITY,  EXCLUSIVITY,  OR 
RESULTS  OBTAINED  FROM  USE  OF  THE  MATERIAL.  CARNEGIE  MELLON 
UNIVERSITY  DOES  NOT  MAKE  ANY  WARRANTY  OF  ANY  KIND  WITH  RESPECT 
TO  FREEDOM  FROM  PATENT,  TRADEMARK,  OR  COPYRIGHT  INFRINGEMENT. 

Use  of  any  trademarks  in  this  presentation  is  not  intended  in  any  way  to  infringe  on  the 
rights  of  the  trademark  holder. 

This  Presentation  may  be  reproduced  in  its  entirety,  without  modification,  and  freely 
distributed  in  written  or  electronic  form  without  requesting  formal 
permission.  Permission  is  required  for  any  other  use.  Requests  for  permission  should 
be  directed  to  the  Software  Engineering  Institute  at  permission@sei.cmu.edu. 

This  work  was  created  in  the  performance  of  Federal  Government  Contract  Number 
FA8721-05-C-0003  with  Carnegie  Mellon  University  for  the  operation  of  the  Software 
Engineering  Institute,  a  federally  funded  research  and  development  center.  The 
Government  of  the  United  States  has  a  royalty-free  government-purpose  license  to 
use,  duplicate,  or  disclose  the  work,  in  whole  or  in  part  and  in  any  manner,  and  to  have 
or  permit  others  to  do  so,  for  government  purposes  pursuant  to  the  copyright  license 
under  the  clause  at  252.227-7013. 


Software  Engineering  Institute  CamegieMellon 


Architecture  +  TSP  =  High  Quality  +  Fast 

©2011  Carnegie  Mellon  University 


46 


